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(54) IMAGE PICKUP DEVICE 

(57) An imaging apparatus according to the present 
invention comprises: a CCD 3 for receiving light ema- 
nated from an object through a color filter 2 and convert- 
ing it into a video signal; a color separator circuit 6 for 
separating the video signal from the CCD 3 into three. 
R, G, and B, signal components; three. R, G, and B sig- 
nal converters 50, 60. and 70 for converting the R, G, 
and B signal components from the color separator cir- 
cuit 6 to a high resolution R signal component, a high 



resolution G signal component, and a high resolution B 
signal component respectively which are higher in the 
resolution than the original signal components; and a 
signal processor circuit 80 for receiving and processing 
the high resolution R, G, and B signal components of 
their respective signal converters 50, 60, and 70 to yield 
a luminance signal as well as a chrominance signal. 
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Description 

Technical Field 

The present invention relates to an imaging appara- s 
tus using a charge coupled device (referred to as a 
CCD) and particularly, to an imaging apparatus for pro- 
ducing a video signal of high resolution with a CCD. 

Background Art w 

Imaging apparatuses with CCD are well known for 
viewing an object and in response, producing a video 
signal. Such known imaging apparatuses will now be 
described referring to Figs.1 and 2. is 

Fig.1 is a block diagram showing an example of the 
imaging apparatus of single array type provided with 
one CCD for producing a video signal. 

Light emanated from an object is introduced from 
an optical system 1 and transmitted through a color filter 20 
2 to a CCD 3. The color filter 2 is a complementary color 
filter assembly comprising, for example, a yellow filter, a 
cyan filter, and a magenta filter. The object emanated 
light is then subjected to photoelectric process in the 
CCD 3 before transferred as a video signal to a video 25 
amplifier 4. The video signal is amplified by the video 
amplifier 4 to a predetermined level and sent to an A/D 
converter circuit 5 where it is converted to a digital sig- 
nal of a given bit format The digital video signal from 
the A/D converter circuit 5 is further transmitted to a 30 
color separator circuit 6. 

The color separator circuit 6 divides the digital 
video signal into three, R, G, and B, signal components 
which are then fed to a signal processor circuit 7. The 
signal processor circuit 7 performs common signal 35 
processing and matrix operations over the R, G, and B 
signal components to yield a luminance signal Y and 
two color^jifference signals R-Y and B-Y. The R-Y and 
B-Y signals of the signal processor circuit 7 are then 
transferred to a modulator circuit 8. 40 

The modulator circuit 8 operates orthogonal two- 
axis (two-phase) modulation of a chrominance subcar- 
rier with the R-Y and B-Y signals to produce a carrier 
chrominance signal (referred to as a chroma signal) 
which is then supplied to one of two inputs of an adder 45 
9. The other input of the adder 9 receives the Y signal 
from the signal processor circuit 7. The chroma signal 
from the modulator circuit 8 and the Y signal from the 
processor circuit 7 are combined to a digital composite 
video signal which is released from an output terminal so 
10. 

The conventional imaging apparatus shown in Fig. 1 
is equipped with the single CCD for converting the 
object emanated light into the R, G, and B signal com- 
ponents, thus minimizing its overall size and weight and 55 
being portable. However, the R, G, and B signal compo- 
nents are derived from a limited number of photoelectric 
elements or pixels where each color component is 
assigned to a small group of the pixels and their result- 
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ant signal or the digital composite signal at the output 
terminal 10 will relatively be low in the resolution. 

For increasing the resolution, three-array type has 
been proposed including three CCDs. The three-array 
type of a conventional imaging apparatus will be 
explained referring to Fig.2. 

As shown in Fig. 2. light emanated from an object is 
introduced through an optical system 21 to a color sep- 
arator prism 22. The color separator prism 22 divides 
the object emanated light into three, red, green, and 
blue, colors which are then transferred to a red CCD 23, 
a green CCD 24, and a blue CCD 25 respectively. 

The red, green, and blue CCDs 23, 24, 25 convert 
their respective red, green, and blue light inputs by pho- 
toelectric processing to thee, R. G, and B signal compo- 
nents respectively. The R. G. and B signal components 
are transmitted to three video amplifiers 26, 27, and 28 
respectively where they are amplified to predetermined 
levels before sent to three A/D converter circuits 29, 30, 
and 31 respectively. In their respective A/D converter 
circuits 29. 30, and 31, the R. G. and B signal compo- 
nents are converted to digital signals which all are trans- 
ferred to a signal processor circuit 32. 

The signal processor circuit 32 performs common 
signal processing and matrix operations over the R, G, 
and B signal components to yield a luminance signal Y 
and two color-difference signals R-Y and B-Y The R-Y 
and B-Y signals of the signal processor circuit 32 are 
then transmitted to a modulator circuit 34. 

The modulator circuit 34 operates orthogonal two- 
axis modulation of a chrominance subcarrier with the R- 
Y and B-Y signals to produce a chroma signal which is 
then supplied to one of two inputs of an adder 35. The 
other input of the adder 35 receives the Y signal from 
the signal processor circuit 32. The chroma signal from 
the modulator circuit 34 and the Y signal from the proc- 
essor circuit 32 are summed to a digital composite video 
signal which is released from an output terminal 36. 

Also, the Y, R-Y t and B-Y signals from the signal 
processor circuit 32 are directly transferred tolhree out- 
put terminals 37, 37, and 39 respectively for further 
delivery as component signals. 

The imaging apparatus shown in Fig.2 has the 
three CCDs provided for yielding the R, G, and B signal 
components respectively and a resultant composite 
video signal will thus be higher in the resolution than 
that of the single-array type shown in Fig.1. 

While high-resolution television systems have been 
developed of which resolution is much higher than that 
of the existing NTSC system, their video signals should 
be created with essentially a greater number of pixels 
than those of the tree-array type conventional CCD 
imaging apparatus. It is understood that the CCD with a 
greater number of pixels requires higher manufacturing 
skills and thus increases its price. This will soar the 
overall cost of manufacturing the imaging apparatus. 

It is an object of the present invention, in view of the 
above predicaments, to provide an imaging apparatus 
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capable of producing a video signal of higher resolution 
without particularly increasing the number of pixels. 

Disclosure of the Invention 

5 

One mode of the present invention is embodied by 
an imaging apparatus which comprises: an imaging 
means for receiving light emanated from an object 
through a color filter and converting it into a video sig- 
nal; a separating means for separating the video signal 10 
from the imaging means into three, R, G, and B, signal 
components; three, first, second and third, converting 
means for converting the R, G. and B signal compo- 
nents from the separating means to a high resolution R 
signal component, a high resolution G signal compo- »s 
nent. and a high resolution B signal component respec- 
tively which are higher in the resolution than the original 
signal components; and a signal processing means for 
receiving and processing the high resolution R, G, and 
B signal components of their respective first, second. 20 
and third converting means to yield a luminance signal 
as well as a chrominance signal. 

Each of the first, second, and third converting 
means may comprise: a block formalizing means for 
grouping the signal component into blocks; a compress- 25 
ing means for compressing data of each block deter- 
mined by the block formalizing means; a class detecting 
means for specifying a class of the block by examining 
a pattern of levets of the compressed data and produc- 
ing a signal indicative of the class; a predictive parame- 30 
ter memory for holding predictive parameters for use in 
converting the signal component to the high resolution 
signal component, and selecting the predictive parame- 
ters in response to the class indication signal from the 
class detecting means; and a predictive operating 35 
means for subjecting the signal component to predictive 
operation with the predictive parameters from the pre- 
dictive parameter memory thus to produce the high res- 
olution signal component. 

Another mode of the present invention is embodied 40 
by an imaging apparatus which comprises: three, first, 
second, and third, imaging means for receiving and 
converting red color light, green color light, and blue 
color light into R. G, and B signal components respec- 
tively; three, first, second and third, converting means 45 
for converting the R, G, and B signal components from 
the first, second, and third imaging means to a high res- 
olution R signal component, a high resolution G signal 
component, and a high resolution B signal component 
respectively which are higher in the resolution than the so 
original signal components; and a signal processing 
means for receiving and processing the high resolution 
R, G, and B signal components of their respective first, 
second, and third converting means to yield a lumi- 
■ nance signal as well as a chrominance signal; 55 
A further mode of the present invention is embodied 
by an imaging apparatus which comprises: an imaging 
means for receiving and converting light emanated from 
an object into a video signal; a signal processing means 



for processing the video signal from the imaging means 
to produce a luminance signal and two, first and second, 
color-difference signals; and three, first, second and, 
third, converting means for converting the luminance 
signals and the first and second color-difference signals 
from the signal processing means to a high resolution 
luminance signal and two. first and second, high resolu- 
tion color-difference signals which are higher in the res- 
olution than the original luminance and color-difference 
signals. 

A still further mode of the present invention is 
embodied by an imaging apparatus which comprises: 
an imaging means for receiving and converting light 
emanated from an object into a video signal; a signal 
processing means for processing the video signal from 
the imaging means to produce a luminance signal and a 
chrominance signal; a combining means for producing a 
composite video signal from the luminance and chromi- 
nance signals of the signal processing means; and a 
converting means for converting the composite video 
signal from the combining means to a high resolution 
composite video signal which is higher in the resolution 
than the original composite video signal. 

Brief Description of the Drawings 

Fig.1 is a block diagram showing a conventional 
imaging apparatus. 

Fig. 2 is a block diagram showing another conven- 
tional imaging apparatus. 

Fig. 3 is a block diagram of a first embodiment of an 
imaging apparatus according to the present invention. 

Fig. 4 is a schematic diagram showing a two-dimen- 
sional array of pixels for SD and HD signals. 

Fig.5 is a schematic diagram showing a one-dimen- 
sional array of pixels for SD and HD signals. 

Fig.6 is a graphic diagram of a change in the signal 
level explaining ADRC coding. 

Fig.7 is a graphic diagram explaining quantization 
in the ADRC coding. 

Fig. 8 is a block diagram showing a one-bit ADRC 
coding circuit. 

Fig.9 is a diagram showing a table of the SD signal 
pixels for predicting the HD signal pixels. 

Fig. 10 is a flow chart explaining the action of a sig- 
nal converter. 

Fig.1 1 is a block diagram showing schematically an 
assembly for determining predictive parameters through 
learning process. 

Fig.1 2 is a flow chart explaining the learning proc- 
ess. 

Fig. 13 is a block diagram of a second embodiment 
of the imaging apparatus of the present invention. 

Fig. 14 is a block diagram of a third embodiment of 
the imaging apparatus of the present invention. 

Fig.1 5 is a block diagram of a fourth embodiment of 
the imaging apparatus of the present invention. ' 
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Best Mode for Carrying Out The Invention 

Preferred embodiments of the present invention will 
be described referring to the accompanying drawings. 

Fig.3 illustrates a first embodiment of the present 
invention. As shown, an imaging apparatus is provided 
with a single CCD (charge coupled device) composed 
of solid-state photoelectric elements or pixels for gener- 
ating three, red (R), green (G), and blue (B), signal com- 
ponents corresponding to the primary colors of light, 
converting them into high resolution signals, and sum- 
ming the high resolution signals to a composite video 
signal of the high resolution, rt is now assumed that the 
signal component before converted to a high resolution 
signal is termed as an SD (standard definition) signal 
and the high resolution signal is called as a HD (high 
definition) signal. 

Like components shown in Fig.3 are denoted by like 
numerals as those in Fig.1 for ease of the description. 

Light emanated from an object is introduced from 
an optical system 1 and transmitted through a color filter 
2 to a CCD 3. The color filter 2 is a complementary color 
filter assembly comprising, for example, a yellow filter, a 
cyan filter, and a magenta filter. The object emanated 
light is then subjected to photoelectric process in the 
CCD 3 before transferred as a video signal to a video 
amplifier 4. The video signal is amplified by the video 
amplifier 4 to a predetermined level and sent to an A/D 
converter circuit 5 where it is converted to a digital sig- 
nal of a given bit format The digital video signal from 
the A/D converter circuit 5 is further transmitted to a 
color separator circuit 6. 

The color separator circuit 6 divides the digital 
video signal into three, R, G, and B, signal components 
which are then fed to an R signal converter 50, a G sig- 
nal converter 60, and a B signal converter 70 respec- 
tively. 

As shown in Fig.3, the R signal converter 50 com- 
prises a block formatting circuit 51 for grouping the R 
signal component from the color separator circuit 6 into 
blocks, a data compressing circuit 53 for compressing 
each block of the R signal component from the block for- 
malizing circuit 51, a class code determining circuit 53 
for identifying a class to which the block of the R signal 
component compressed by the data compressing circuit 
52 is attributed through examining a level pattern of the 
R signal component and determining a corresponding 
class code, a predictive parameter memory 54 for spec- 
ifying predictive parameters in response to the class 
code from the class code producing circuit 53, and a 
predicted value generating circuit 55 for subjecting the 
block of the R signal component from the block formal- 
izing circuit 5 1 to predictive operation with the predictive 
parameters supplied from the predictive parameter 
memory 54. 

Similarly, the G signal converter 60 comprises a 
block formatting circuit 61 for grouping the G signal 
component from the color separator circuit 6 into blocks, 
a data compressing circuit 63 for compressing each 



block of the G signal component from the block formal- 
izing circuit 61, a class code determining circuit 63 for 
identifying a class to which the block of the G signal 
component compressed by the data compressing circuit 

5 62 is attributed through examining a level pattern of the 
G signal component and determining a corresponding 
class code, a predictive parameter memory 64 for spec- 
ifying predictive parameters in response to the class 
. code from the class code producing circuit 63. and a 

10 predicted value generating circuit 65 for subjecting the 
block of the G signal component from the block formal- 
izing circuit 61 to predictive operation with the predictive 
parameters supplied from the predictive parameter 
memory 64, as shown in Fig.3. 

is Furthermore, the B signal converter 70 comprises a 
block formatting circuit 71 for grouping the B signal com- 
ponent from the color separator circuit 6 into blocks, a 
data compressing circuit 73 for compressing each block 
of the B signal component from the block formalizing cir- 

20 cuit 71 , a class code determining circuit 73 for identify- 
ing a class to which the block of the B signal component 
compressed by the data compressing circuit 72 is attrib- 
uted through examining a level pattern of the B signal 
component and determining a corresponding class 

25 code, a predictive parameter memory 74 for specifying 
predictive parameters in response to the class code 
from the class code producing circuit 73, and a pre- 
dicted value generating circuit 75 for subjecting the 
block of the B signal component from the block formaliz- 

30 ing circuit 71 to predictive operation with the predictive 
parameters supplied from the predictive parameter 
memory 74. 

The resultant high resolution R, G, and B signal out- 
puts from their respective signal converters 50, 60, and 

55 70 are transferred to a signal processor circuit 80. 

The signal processor circuit 80 performs common 
signal processing and matrix operations over the high 
resolution R, G, and B signal outputs to yield a high res- 
olution luminance signal Y and two high resolution 

40 color-difference signals R-Y and B-Y. The construction 
and operating principles of the signal processor circuit 
80 is well known and will be explained in no more 
details. It should be noted that the signal processor cir- 
cuit 80 is tailored to operate at a higher rate than that of 

45 the signal processor circuit 7 of the conventional imag- 
ing apparatus shown in Fig.1 . 

The high resolution R-Y and B-Y signals of the sig- 
nal processor circuit 80 are then transmitted to a modu- 
lator circuit 81. The modulator circuit 81 operates 

so orthogonal two-axis (two-phase) modulation of a 
chrominance subcarrier with the high resolution R-Y 
and B-Y signals to produce a high resolution chroma 
signal which is then supplied to one of two inputs of an 
adder 82. The other input of the adder 82 receives the 

55 high resolution Y signal from the signal processor circuit 
80. The high resolution chroma signal from the modula- 
tor circuit 81 and the high resolution Y signal from the 
processor circuit 80 are combined to a digital composite 
video signal of high resolution which is released from an 
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output terminal 10. Also, the modulator circuit 81 and 
adder 82 are tailored to operate at higher rates than 
those of the modulator circuit 8 and adder 9 of the con- 
ventional imaging apparatus shown in Fig.1 . 

The action of the imaging apparatus of the first 
embodiment of the present invention shown in Fig.3 will 
now be described. 

The object emanated light is directed through the 
optical system 1 and the color filter 2 to the CCD 3 
where it is photoelectric processed to a video signal. 
The video signal is amplified by the video amplifier 4 to 
a predetermined leveJ and sent to the A/D converter cir- 
cuit 5 where it is converted to a digital signal. The digital 
video signal is then divided by the color separator circuit 
6 into three, R, G, and B, signal components which are 
fed to the R. G, and B signal converters 50. 60. and 70 
respectively- After the R. G. and B. signal components 
are converted to their respective high resolution R. G. 
and B signal outputs, they are transferred to the signal 
processor circuit 80 which in turn produces the high res- 
olution luminance Y signal and the two high resolution 
color-difference, R-Y and B-Y, signals. 

The high resolution R-Y and B-Y signals are trans- 
mitted to the modulator circuit 81 where it is used for 
orthogonal two-axis modulation of a chrominance sub- 
carrier to yield a high resolution chroma signal. The high 
resolution chroma signal from the modulator circuit 81 
and the high resolution Y signal from the signal proces- 
sor circuit 80 are summed by the adder 82 yielding to a 
digital composite video signal of high resolution at the 
output terminal 10. 

Accordingly, with the common CCD composed of a 
traditional number of pixels, the digital composite video 
signal can be produced having a higher resolution than 
that of the conventional imaging apparatus. 

The construction and operating principles of the R, 
G. and B signal converters 50, 60, and 70 will be 
described in more details. 

The three, R. G, and B, signal converters 50, 60, 
and 70 are identical in the construction and operating 
principles and the description will be made referring to 
the R signal converter 50. It should be noted that the 
description is minimum for understanding of the imaging 
apparatus of the present invention since the construc- 
tion and operating principles of a similar signal con- 
verter have been disclosed in WIPO International 
Publication WO 94/14278. 

Referring to Fig.3, the SD signal supplied to the 
block formalizing circuit 51 in the R signal converter 50 
is a digital signal with a format of 8 bits per pixel or pixel 
sampled at a specific sampling frequency. The SD sig- 
nal of raster scan sequential data is grouped by the 
block formalizing circuit 51 to one-, two-, or three- 
dimensional blocks. 

The signal output from the block formalizing circuit 
51 is transferred to both the data compressing circuit 52 
and the predicted value generating circuit 55. The out- 
put of the data compressing circuit 52 is. fed to the class 
code determining circuit 53 which in turn determines 



and sends a class code as an address signal to the pre- 
dictive parameter memory 54, The predictive parameter 
memory 54 holds a table of predictive parameters deter- 
mined through learning process. The predictive value 
5 generating circuit 55 receives predictive parameters 
selected at the predictive parameter memory 54. 

In the data compressing circuit 52 and class code 
determining circuit 53, target pixels for the prediction 
are classified according to a pattern of levels of the 
10 block data including data from the target pixels. Hence, 
the class code determining circuit 53 delivers a resultant 
class code representing a class determined by the clas- 
sification. The classification is conducted over the SD 
signal. If 8-bit neighbor pixels of the SD signal (referred 
is to as SD pixels) about the target pixels are directly ref- 
erenced, their classes will be increased in number. For 
compensation, the data compressing circuit 52 is pro- 
vided for compressing bit data of the (reference) neigh- 
bor pixels. The data compressing circuit 52 may be an 
20 ADRC (adaptive dynamic range coding) encoder circuit. 
The compression of data is not limited to the ADRC 
but other known methods may be used with equal suc- 
cess including DCT (discrete cosine transform). VQ 
(vector quantization), DPCM (differential pulse code 
25 modulation). BTC (block truncation coding), and non- 
linear quantization. 

The block formalizing circuit 51 shifts the SD signal 
from raster scan sequence format of the television sig- 
naJ to two-dimensional block format, as shown in Fig.4. 
30 Fig.4 illustrates one block comprising 3x3 pixels, 9 SD 
pixels denoted by a to i. Accordingly, four HD pixels. A to 
D, about an SD pixel located in the center of a block are 
specified by the predicted value generating circuit 55. 
While the block shown in Fig.4 is an example, a 
35 one-dimensional block comprising 4 SD pixels, a to d, 
may be used for generating the predicted value of HD 
pixel. Also, three-dimensional blocks will be utilized with 
equal success. 

As shown in Fig.5, HD pixels of class A are deter- 
40 mined by a, b. and c of the SD pixels and c and of class 
B by a, b, c, and d thus generating corresponding pre- 
dicted values. The class and predicted value can also 
be specified through the learning process. 

The ADRC coding applicable to the data compress- 
45 ing circuit 52 will now be explained in details. 

The ADRC coding allows adaptive reduction of a 
redundancy of the level range in consideration of local 
correlation of the pixels. For example, as shown in Fig.6, 
a dynamic range A or B of levels in each block to be 
so quantized is much smaller than the entire dynamic 
range. 0 to 255, of the 8-bit format. Therefore, the for- 
mat for quantization can be reduced from 8 bits to a 
small number. 

Assuming that a smaller number of bits than the 
55 original number or eight is p, the dynamic range of a 
block is DR. the level of a pixel in the block is x, and the 
requantized code is Q, the following equations (1) are 
established for the block of which amplitude is divided 
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by 2p between the upper limit, MAX and the lower limit, 
MIN; 

DR=MAX-MIN+1 (1) 

CH(x-MIN+0.5)x2 P /DR] 

where [z] represents the largest integer below z. 

Then, an average of pixel levels in the block of the 
p-bit format is calculated in the range of 2p-1 levels as 
shown in Fig.7(a) and its value is designated as a new 
upper limit MAX', as shown in Fig. 7(b). When the small- 
est level of the pixels in the block is MIN' equivalent to 0 
of the original level range, the dynamic range is shifted 
from between MAX and MIN to between MAX' to MIN'. 
Accordingly, the following equations (2) are now estab- 
lished; 

DR'sMAX'-MIN* (2) 
q=[(x-MIN')x(2 p -1)/DR+0.5] 

where [z] represents the largest integer blow z. 

Because the dynamic range DR* is definitely tai- 
lored between MAX' and MIN', the data compression of 
ADRC coding can be increased in efficiency without 
intervention of noise. 

The quantization of ADRC is also capable of having 
a reproduced level equal to MAX or MIN. 

In case of the two-dimensional blocks, nine 8-bit 
pixel values are converted by the compressing action of 
ADRC to n p-bit pixel values which are transferred to the 
class code determining circuit 53. Thus, the class code, 
class, representing a class of the n values is expressed 
by: 



class = £g,(2 p )' (3) 
/=1 

The action of a one-bit ADRC encoder circuit will be 
explained referring to Fig.8. 

As shown in Fig. 8, the blocks of data are fed in 
sequence to an input terminal 121 and examined by a 
detector circuit 122 to specify MAX and MIN of pixels in 
each block. MAX and MIN levels are transferred to a 
subtracter circuit 123 where MIN is subtracted from 
MAX to have a dynamic range DR. Simultaneously, MIN 
level is fed to another subtracter circuit 124 where it is 
subtracted from the level of a pixel to have an initialized 
value. 

The dynamic range DR and the initialized value are 
transferred to a divider circuit 125 where the initialized 
value is divided by the dynamic range to calculate a 
quotient which is sent to -a comparator circuit 126. The 
comparator circuit 126 examines whether or not the 
quotient from each of the 9 pixels is greater than 0.5 of 
a reference value. As the result, one-bit data DT of 
either 0 or 1 is released from an output terminal 127 



depending on the value of the quotient. Through the 
one-bit ADRC process, a class of the SD block of 3x3 
pixels can be expressed by a 9-bit class code. 

Returning to Fig.3, predictive parameters corre- 

5 spending to the class code are read from the predictive 
parameter memory 54 and transferred to the predicted 
value generating circuit 55 where a predicted value y' for 
HD pixel is calculated by linear combination of the SD 
values in blocks and the predictive parameters w1 to wn 

10 as is expressed by: 

y'=w 1 x 1 +w 2 x 2 +....+w n x n (4) 

More particularly, Fig.4 shows n=9 and the HD pixel 
is to be predicted can be determined by one of the SD val- 
ues x1 to x9 in view of a table shown in Fig.9. 

For calculating the predicted value of each of the 
four HD pixels A to D in a block, the SD pixel to be asso- 
ciated with the predictive parameters is shifted depend- 
20 ing on the location of the HD pixel. If the HD pixel is A, 
the predicted value is calculated from: 

y*=w 1 a+w 2 b+w 3 c+...+w n i (5) 

2B Also, if the HD pixel is B, the predicted value is cal- 
culated from: 

y'=w 1 a+w 2 d+w 3 c+...+w n e (6) 

30 As apparent, the same parameters can be used for 
calculating the predicted values of different HD pixels in 
one block (i.e. in the same class). Hence, the predictive 
parameter memory 54 can be reduced in the storage 
size and access action thereto will be minimized in 

3£ number. It should be noted that the relation between the 
SD values x1 to x9 multiplied by the parameters and the 
SD pixels a to i shown in the table of Fig.9 is defined by 
the distance from the target HD pixels to the SD pixels. 
TTie values x1 to x9 may possibly be allocated to 

40 nine bits of the class code defined by the one-bit ADRC 
process. In other words, the class assigned to each of 
the HD pixels A to D about the center of a block may be 
identified by changing the sequence of bits of the com- 
pressed data of the SD pixels a to i. It is thus possible 

45 that the bits have been stored in a memory and when 
requested are read in a desired sequence for defining 
the class. 

Fig. 10 is a flow chart showing the procedure of up 
converting from the SD signal to the HD signal. 

so Tne up conversion procedure starts with Step 131 
and the SD signal is grouped to blocks at Step 132, 
allowing SD pixels in each block to be processed as 
shown in Fig.4. It is then examined at Step 1 33 whether 
or not the data of all pixels has been processed. If yes, 

55 the procedure goes to Step 137 and is terminated. 
When the data is not processed, the procedure 
advances to Step 134 for determining the class. 

At Step 134, the class is identified by examining a 
pattern of levels of the SD signal. For example, the com- 
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pressed data from the one-bit ADRC process is used to 
identify the class. Then, the predictive parameters cor- 
responding to the class codes are read from their mem- 
ory at Step 135. This is followed by Step 136 where the 
predicted value y* for HD pixel is calculated using the (4) 
equations. This sequence of steps is repeated for all the 
data and after the data are all completed, the procedure 
moves through Step 133 to Step 137 to terminate its up 
conversion routine. 

The predictive parameter memory 54 holds a given 
number of the predictive parameters defined by the 
learning process. The learning process will now be 
explained. Fig.l 1 is a block diagram showing an assem- 
bly for learning the predictive parameters. 

A large number of typical HD signals of still image 
are loaded to an input terminal 141 and transmitted 
directly to both a vertical decimation filter 142 and a 
learning unit 144. The vertical decimation filter 142 car- 
ries out vertical decimation of the HD signal. A vertically 
decimated HD signal is then fed to a horizontal decima- 
tion filter 143 connected to the output of the vertical dec- 
imation fitter 142 where it is horizontally decimated to 
1/2. Accordingly, the decimated HD signal is a video sig- 
nal indicative of less pixels which are equal in number to 
those of an SD signal as is transferred to the learning 
unit 1 44. The video signal is then grouped to classes by 
a classifying circuit in the learning unit 144 and the pre- 
dictive parameters w1 to wn are stored in the addresses 
defined by the classes in a predictive parameter mem- 
ory 145. 

The down conversion of the HD signal to the SD 
signal is not limited to the above method using the dec- 
imation filters but other applicable methods can be 
used. For example, The SD pixel a may be identified by 
averaging four, 2x2, pixels (e.g. A, B, C, and D) as 
shown in Fig.4. Also, the SD pixel may be specified by a 
weighted average of more number of HD pixels (e.g. all 
the HD pixels in one block) rather than the simple aver- 
age. 

If the block comprises 3x3 SD pixels as shown in 
Fig. 4, a learn data is determined in the learning unit 144 
from the SD pixels a to i and the four HD pixels A, B, C, 
and D. As a plurality of the learn data are given in a 
frame, a more number of the learn data can be prepared 
when the number of frames is increased. 

The learning unit 144 performs a classification in 
which the class is determined by compressing the SD 
pixels a to i to a size and examining a two-dimensional 
pattern of the compressed SD data size, and an arith- 
metic operation of calculating the predictive parameters 
for the class by the method of least squares. The classi- 
fication is identical to the actions of the data compress- 
ing circuit 52 and the class code determining circuit 53 
shown in Fig.3. The procedure of operation of the learn- 
ing unit 1 44 in the form of software is shown in a flow 
chart of Fig. 12. 

As shown, the procedure in the learning unit 144 
starts with Step 151 and goes to Step 152 where both 
the HD and SD signals are infed and grouped corre- 



sponding blocks. More specifically, the HD and SD sig- 
nals are allocated to A to D and a to i respectively in a 
combination as shown in Fig.4. It is then examined at 
Step 153 whether or not the allocation of data is com- 

5 plete. If yes, the procedure moves to Step 1 56 for deter- 
mining the predictive parameters. If not. Step 154 
follows for identifying the class. 

At Step 154, the class is identified by a pattern of 
levels of the SD pixels a to i about the four HD pixels A 

w to D to be predicted. In this step, data bits of the SD pix- 
els are reduced in number by commonly the ADRC 
process. This is followed by Step 155 where normal 
equation summing is executed using equations (12). 
(13). and (14) which will be explained later. 

is When it is judged at Step 153 that all the data is 
processed, the procedure advances to Step 156 where 
the predictive parameters are determined through 
matrix solution of the (14) equation. Then, the predictive 
parameters are stored in the memory at Step 157. This 

20 step is followed by Step 158 for terminating the opera- 
tion of the learning unit 144. 

The classification in which the SD pixels a to i 
shown in Fig.4 are compressed to coded forms which 
are then used to determine a class is identical to that of 

25 the signal converter described previously. Similarly, the 
predicted values for the HD pixels A to D are calculated 
through linear combination of the values of the SD pix- 
els a to i and the predictive parameters w1 to wn and 
reference to the table shown in Fig.9 which are 

30 described previously. 

The determining the parameters for predicting the 
HD pixels from the SD pixels will now be explained in 
more details. 

Assuming that the values of the SD pixels are x1 to 

35 xn and the true value of the target HD pixel is y. linear 
combination of n taps with the predictive parameters wT 
to wn is expressed by: 

y'=W,X,+W 2 X 2 +...+W n * n (7) 

40 

Before the learning process, wi is an unknown 
parameter. 

The learning process is applied to more than one of 
the HD and SD data in each class. When the number of 
45 the data is m. the (7) equation is translated to: 

y i '=w 1 x j1 +w 2 x j2 +...+w n x jn ( 8 > 

(wherej=1.2, ...m) 
so If m>n, wi to wn cannot be determined in this man- 
ner. Using an error vector e obtained from equation (9), 
the predictive parameter is calculated which minimizes 
the following equation (10): 

55 e J =y J , -(w 1 x j1 +w 2 x J2 +...+w n x Jn ) (9) 

m 

£ 2 = £{e ; -} 2 ' 00) 
y-o 
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The (10) equation represents a solution of least 
squares. Then, a partial differential parameter of wi from 
the (1 0) equation is calculated as expressed by: 

'y-o * y-o 

The predictive parameter wi is given when the (11) 
equation is closed to zero. When the entries are w 
expressed by: 

m 
p-0 

Y '-L x a m ?i 

y-o 

their matrix is: 





x i2 : 


- *1n 










x 21 




' : X 2n 


























X n 2 * 






. w n- 







When the (14) matrix has been solved by a 
matrix solution method such as sweep out, the predic- 
tive parameter wi is obtained. The predictive parameter 
is then stored in the memory using its class code as an 
address. 

In this manner, the learning unit 144 can determine ss 
the predictive parameter wi from the true data of the HD 
signal. As explained previously, the predictive parame- 
ters determined by the learning unit 144 are stored in 
the prediction parameter memory 54 of Fig.3. 

A second embodiment of the imaging apparatus of 40 
the present invention will be described referring to 
Fig. 13. Like components are denoted by like numerals 
as those in Fig.2 and will be explained in no more 
details. 

As shown in Fig. 13. light emanated from an object 4S 
is introduced through an optical system 21 to a color 
separator prism 22. The color separator prism 22 
divides the object emanated light into three, red, green, 
and blue, colors which are then transferred to a red 
CCD 23, a green CCD 24, and a blue CCD 25 respec- so 
lively. 

The red. green, and blue CCDs 23, 24, 25 convert 
their respective red, green, and blue light inputs by pho- 
toelectric processing to thee, R, G, and B signal compo- 
nents respectively. Trie R, G, and B signal components ss 
are transmitted to three video amplifiers 26, 27. and 28 
respectively where they are amplified to predetermined 
levels before sent to three A/D converter circuits 29. 30, 
and 31 respectively. In their respective A/D converter 



circuits 29, 30, and 31, the R, G, and B signal compo- 
nents are converted to digital signals which are trans- 
ferred to an R signal converter 200, a G signal converter 
210, and a B signal converter 220 respectively. 

The R signal converter 200 comprises, as shown in 
Fig. 13, a block formalizing circuit 201, a data compress- 
ing circuit 202, a class code determining circuit 203. a 
predictive parameter memory 204. and a predicted 
value generating circuit 205. 

Similarly, the G signal converter 210 comprises, as 
shown in Fig. 13. a block formalizing circuit 21 1, a data 
compressing circuit 212. a class code determining cir- 
cuit 213, a predictive parameter memory 214. and a 
predicted value generating circuit 215. 

Also the B signal converter 220 comprises a block 
formalizing circuit 221. a data compressing circuit 222. 
a class code determining circuit 223, a predictive 
parameter memory 224. and a predicted value generat- 
ing circuit 225. 

The construction and operational principles of the 
R, G, and B signal converters 200. 210, 220 are identi- 
cal to those of the R signal converter 50 shown in Fig. 3 
and their description will be omitted. 

Resultant high resolution R. G. and B signal outputs 
from their respective signal converters 200, 210. and 
220 are transferred to a signal processor circuit 230. 

The signal processor circuit 230 performs common 
signal processing and matrix operations over the high 
resolution R, G, and B signal outputs to yield a high res- 
olution luminance signal Y and two high resolution 
color-difference signals R-Y and B-Y. The high resolu- 
tion R-Y and B-Y signals of the signal processor circuit 
230 are then transmitted to a modulator circuit 240. 

The modulator circuit 240 operates orthogonal two- 
axis modulation of a chrominance subcarrier with the 
high resolution R-Y and B-Y signals to produce a high 
resolution chroma signal which is then supplied to one 
of two inputs of an adder 250. The other input of the 
adder 250 receives the high resolution Y signal from the 
signal processor circuit 230. The high resolution chroma 
signal from the modulator circuit 240 and the high reso- 
lution Y signal from the processor circuit 230 are com- 
bined to a digital composite video signal of high 
resolution which is released from an output terminal 
260. The signal processor circuit 230, modulator circuit 
240, and adder 350 are tailored to operate at higher 
rates than those of the signal processor circuit 32, mod- 
ulator circuit 34, and adder 35 of the conventional imag- 
ing apparatus shown in Fig.2. 

In addition, the high resolution Y. R-Y, and B-Y sig- 
nals from the signal processor circuit 230 are directly 
connected to three other output terminals 270, 280, and 
290 respectively for further transmission as high resolu- 
tion component signals. 

A third embodiment of the imaging apparatus of the 
present invention will be described referring to Fig. 14. 
Like components are denoted by like numerals as those 
in Fig. 1 and will be explained in no more details. 
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Light emanated from an object is directed through a 
color filter 2 to a CCD 3. The color filter 2 is a comple- 
mentary color filter assembly comprising, for example, a 
yellow filter, a cyan filter, and a magenta filter. The 
object emanated light is then subjected to photoelectric 
process in the CCD 3 before transferred as a video sig- 
nal to a video amplifier 4. The video signal is amplified 
by the video amplifier 4 to a predetermined level and 
sent to an A/D converter circuit 5 where it is converted 
to a digital signal of a given bit format. The digital video 
signal from the A/D converter circuit 5 is further trans- 
mitted to a color separator circuit 6. 

The color separator circuit 6 divides the digital 
video signal into three. R. G. and 6. signal components 
which are then fed to a signal processor circuit 7. The 
signal processor circuit 7 performs common signal 
processing and matrix operations over the R. G. and B 
signal components to yield a luminance signal Y and 
two color-difference signals R-Y and B-Y Tne R-Y and 
B-Y signals of the signal processor circuit 7 are then 
transferred to a modulator circuit 8. 

The modulator circuit 8 operates orthogonal two- 
axis modulation of a chrominance subcarrier with the R- 
Y and B-Y signals to produce a chroma signal which is 
then supplied to one of two inputs of an adder 9. The 
other input of the adder 9 receives the Y signal from the 
signal processor circuit 7. The chroma signal from the 
modulator circuit 8 and the Y signal from the processor 
circuit 7 are summed to a digital composite video signal. 

The digital composite video signal from the adder 9 
is transferred to a signal converter 300 in which it is 
shifted to its high resolution version before released 
from an output terminal 310. The construction and oper- 
ational principles of the signal processor 300 are identi- 
cal to those of the R signal converter 50 shown in Fig.3 
and will be explained in no more details. As shown in 
Fig. 14, the signal processor 300 comprises a block for- 
malizing circuit 301. a data compressing circuit 302, a 
class code determining circuit 303, a predictive param- 
eter memory 304, and a predicted value generating cir- 
cuit 305 which are identical to the block formalizing 
circuit 51, the data compressing circuit 52, the class 
code determining circuit 53, the predictive parameter 
memory 54. and the predicted value generating circuit 
55 respectively in the R signal converter 50 of Fig.3. 

A fourth embodiment of the imaging apparatus of 
the present invention will now be described referring to 
Fig. 15. Like components are denoted by like numerals 
as those in Fig.2 and will be explained in no more 
details. 

Light emanated from an object is introduced 
through an optical system 21 to a color separator prism 
22. The color separator prism 22 divides the object 
emanated light into three, red. green, and blue, colors 
which are then "transferred to a red CCD 23, a green 
CCD 24, and a blue CCD 25 respectively. 

The red, green, and blue CCDs 23, 24, 25 convert 
their respective red, green, and blue light inputs by pho- 
toelectric processing to thee, R, G, and B signal compo- 



nents respectively. The R. G, and B signal components 
are transmitted to three video amplifiers 26, 27, and 28 
respectively where they are amplified to predetermined 
levels before sent to three A/D converter circuits 29, 30. 
5 and 31 respectively, in their respective A/D converter 
circuits 29, 30. and 31, the R. G, and B signal compo- 
nents are converted to digital signals of a given bit for- 
mat which are transferred to a signal processor circuit 
32. i 
w The signal processor circuit 32 performs common 
signal processing and matrix operations over the R, G, 
and B digital signals to yield a luminance signal Y and 
two color-difference signals R-Y and B-Y. The R-Y and 
B-Y signals of the signal processor circuit 32 are then 
is transmitted to an R-Y signal converter 410 and a B-Y 
signal converter 420 respectively. 

The R-Y signal converter 410 converts the R-Y sig- 
nal of the signal processor circuit 32 to a high resolution 
R-Y signal. Similarly, the B-Y signal converter 420 con- 
20 verts the B-Y signal of the signal processor circuit 32 to 
a high resolution B-Y signal. 

The Y signal from the signal processor circuit 32 is 
transferred to a luminance signal converter 400 where it 
is converted to a high resolution Y signal. 
25 The luminance signal converter 400 comprises, as 
shown in Fig. 15, a block formalizing circuit 401, a data 
compressing circuit 402, a dass code determining cir- 
cuit 403. a predictive parameter memory 404, and a 
predicted value generating circuit 405. 
30 Similarly, the R-Y signal converter 41 0 comprises a 
block formalizing circuit 41 1 , a data compressing circuit 
412, a class code determining circuit 413, a predictive 
parameter memory 414, and a predicted value generat- 
ing circuit 415, as shown in Fig. 15. 
35 Also the B-Y signal converter 420 comprises a 
block formalizing circuit 421 , a data compressing circuit 
422, a class code determining circuit 423, a predictive 
parameter memory 424, and a predicted value generat- 
ing circuit 425. 

40 The construction and operational principles of the 
luminance, R-Y, and B-Y signal converters 400, 410. 
420 are identical to those of the R signal converter 50 
shown in Fig.3 and their description will be omitted. 
Resultant high resolution R-Y and B-Y color-differ- 

45 ence signals generated by their respective R-Y and B-Y 
signal converters 410 and 420 are transmitted to a mod- 
ulator circuit 430. The modulator circuit 430 operates 
orthogonal two-axis modulation of a chrominance sub- 
carrier with the high resolution R-Y and B-Y signals to 

so produce a high resolution chroma signal which is then 
supplied to one of two inputs of an adder 440. The other 
input of the adder 440 receives the high resolution Y 
signal from the luminance signal processor circuit 400. 
The high resolution chroma signal from the modulator 

55 circuit 430 and the high resolution Y signal from the 
processor circuit 400 are combined to a digital compos- 
ite video signal of high resolution which is released from 
an output terminal 450. The modulator circuit 430 and 
adder 440 are tailored to operate at higher rates than 
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those of the modulator circuit 34 and adder 35 of the 
conventional imaging apparatus shown in Fig.2. 

In addition, the high resolution Y, R-Y ( and B-Y sig- 
nals from the luminance, R-Y, and B-Y signal converters 
400, 41 0. 420 are directly connected to three other out- 5 
put terminals 460, 470, and 480 respectively for further 
transmission as high resolution component signals. 

The imaging apparatus of the present invention are 
not limited to the foregoing, first to fourth, embodiments, 
but other modifications will be possible without depart- 
ing from the scope of the present invention, including, 
for instance, provision of one common predictive 
parameter memory for conversion process of three, R. 
G, and B, signal components. 

As set forth above, the present invention provides 
an improved imaging apparatus for producing high res- 
olution video signals without increasing the number of 
CCD pixels. 

Claims 

1. An imaging apparatus comprising: 



2. An imaging apparatuses set forth in claim 1 . further 45 
comprising a combining means for producing a 
composite video signal from the luminance and 
chrominance signals of the signal processing 
means. 

! 50 

3. An imaging apparatus as set forth in claim 1, 
wherein each of the first, second, and third convert- 
ing means comprises:; 

block formalizing means for grouping the signal 55 
component into blocks; 

compressing means for compressing data of 
each block determined by the block formalizing 
means; 



class detecting means for specifying a class of 
the block by examining a pattern of levels of the 
compressed data and producing a signal indic- 
ative of the class; 

a predictive parameter memory for holding pre- 
dictive parameters for use in converting the sig- 
nal component to the high resolution signal 
component, and selecting the predictive 
parameters in response to the class indication 
signal from the class detecting means; and 
predictive operating means for subjecting the 
signal component to predictive operation with 
the predictive parameter, from the predictive 
parameter memory thus to produce the high 
resolution signal component. 

4. An imaging apparatus comprising: 

three, first, second, and third, imaging means 
for receiving and converting red color light, 
green color light, and blue color light into R. G, 
and B signal components respectively; 
three, first, second and third, converting means 
for converting the R, G, and B signal compo- 
nents from the first, second, and third imaging 
means to a high resolution R signal compo- 
nent, a high resolution G signal component, 
and a high resolution B signal component 
respectively which are higher in the resolution 
than the original signal components; and 
signal processing means for receiving and 
processing the high resolution R, G, and B sig- 
nal components of their respective first, sec- 
ond, and third converting means to yield a 
luminance signal as well as a chrominance sig- 
nal. 

5. An imaging apparatus as set forth in claim 4, further 
comprising a combining means for producing a 
composite video signal from the luminance and 
chrominance signals of the signal processing 
means. 

6. An imaging apparatus as set forth in claim 4, 
wherein each of the first, second, and third convert- 
ing means comprises: 

block formalizing means for grouping the signal 
component into blocks; 

compressing means for compressing data of 
each block determined by the block formalizing 
means; 

class detecting means for specifying a class of 
the block by examining a pattern of levels of the 
compressed data and producing a signal indic- 
ative of the class; 

a predictive parameter memory for holding pre- 
dictive parameters for use in converting the sig- 
nal component to the high resolution signal 
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20 



imaging means for receiving light emanated 
from an object through a color filter and con- 25 
verting it into a video signal; 
separating means for separating the video sig- 
nal from the imaging means into three, R, G, 
and B, signal components; 

three, first, second and third, converting means so 
for converting the R, G, and B signal compo- 
nents from the separating means to a high res- 
olution R signal component, a high resolution G. . 
signal component, and a high resolution B sig- 
nal component respectively which are higher in 35 
the resolution than the original signal compo- 
nents; and 

signal processing means for receiving and 
processing the high resolution R, G, and B sig- 
nal components of their respective first, sec- 40 
ond, and third converting means to yield a 
luminance signal as well as a chrominance sig- 
nal. 
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component, and selecting the predictive 
parameters in response to the class indication 
signal from the class detecting means; and 
predictive operating means for subjecting the 
signal component to predictive operation with 
the predictive parameters from the predictive 
parameter memory thus to produce the high 
resolution signal component. 

7. An imaging apparatus comprising: 

imaging means for receiving and converting 
light emanated from an object into a video sig- 
nal; 

signal processing means for processing the 
video signal from the imaging means to pro- 
duce a luminance signal and two, first and sec- 
ond, color-difference signals; and 
three, first, second and third, converting means 
for converting the luminance signals and the 
first and second color-difference signals from 
the signal processing means to a high resolu- 
tion luminance signal and two, first and second, 
high resolution color-difference signals which 
are higher in the resolution than the original 
luminance and color-difference signals. 

8. An imaging apparatus as set forth in claim 7. further 
comprising a combining means for producing a 
composite video signal from the high resolution 
luminance signal and the first and second high res- 
olution color-difference signals of the first, second, 
and third converting means respectively. 

9. An imaging apparatus as set forth in claim 7, 
wherein each of the first, second, and third convert- 
ing means comprises: 

block formalizing means for grouping the sup- 
plied signal into blocks; 

compressing means for compressing data of 
each block determined by the block formalizing 
means; 

class detecting means for specifying a class of 
the block by examining a pattern of levels of the 
compressed data and producing a signal indic- 
ative of the class; 

a predictive parameter memory for holding pre- 
dictive parameters for use in converting the 
supplied signal to the high resolution signal, 
and selecting the predictive parameters in 
response to the class indication signal from the 
class detecting means; and 
predictive operating means for subjecting the 
supplied signal to predictive operation with the 
predictive parameters from the predictive 
parameter memory thus to produce the high 
resolution signal. 



10 



10. An imaging apparatus comprising: 

imaging means for receiving and converting 
light emanated from an object into a video sig- 
nal; 

signal processing means for processing the 
video signal from the imaging means to pro- 
duce a luminance signal and a chrominance 
signal; 

combining means for producing a composite 
video signal from the luminance and chromi- 
nance signals of the signal processing means; 
and 

converting means for converting the composite 
video signal from the combining means to a 
high resolution composite video signal which is 
higher in the resolution than the original com- 
posite video signal. 
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An imaging apparatus as set forth in claim 10, 
wherein the converting means comprises: 

block formalizing means for grouping the sup- 
plied signal into blocks; 

compressing means for compressing data of 
each block determined by the block formalizing 
means; 

class detecting means for specifying a class of 
the block by examining a pattern of levels of the 
compressed data and producing a signal indic- 
ative of the class; 

a predictive parameter memory for holding pre- 
dictive parameters for use in converting the 
supplied signal to the high resolution signal, 
and selecting the predictive parameters in 
response to the class indication signal from the 
class detecting means; and 
predictive operating means for subjecting the 
supplied signal to predictive operation with the 
predictive parameters from the predictive 
parameter memory thus to produce the high 
resolution signal. 
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